(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
4 April 2002 (04.04.2002) 




(10) International Publication Number 

PCT WO 02/26125 A2 



(51) laternational Patent Classification'': 



A61B 5/00 



(21) International Application Number: PCTAJSOl/30011 

(22) International Filing Date: 

26 September 2001 (26.09.2001) 



(25) Filing Language: 



(26) Publication Language: 



English 



English 



(30) Priority Data: 
09/669,395 



26 September 2000 (26.09.2000) US 



(71) Applicant: VITAL IMAGES, INC. [US/US]; Suite 200, 
3300 Fembrook Lane North, Plymouth, MN 55447 (US). 

(72) Inventors: ARGIRO, Vincent, J.; 1617 West Franklin 
Avenue, Minneapolis, MN 5540S (US). BREJL, Marek; 
Apartment 211, 15720 Rockford Road, Plymouth, MN 
55446 (US). RASHID, Renee, M.; 1821 Andrea Place. 
Santa Clara, CA 95051 (US). JOHNSON, Todd; Apart- 
ment 21, 2871 South Humboldt Avenue, Minneapolis, MN 
55408 (US). BREJL, Milan; Kultumi 1766, Rozmov pod 
Radhostem 756 61 (CZ). 



(74) Agent: VIKSNINS, Ann, S.; Schwegman, Lundberg, 
Woessner & Kluth, P.O. Box 2938, Minneapolis, MN 
55402 (US). 

(81) Designated States (national)i AE, AG, AL, AM, AT, AU, 

AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, R, GB, GD. GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, PH, PL, PT, RO, RU, SD, SE, SG, SI, 
SK, SL, TJ, TM, TR, TT, TZ, UA, UG, UZ, VN, YU, ZA, 

zw. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH. CY. DE, DK. ES. FI, FR, GB. GR, IE, 
rr. LU. MC. NL, PT, SE, TR). OAPI patent (BF. BJ, CF, 
CG, CI, CM. GA, GN, GQ, GW, ML. MR. NE. SN. TD, 
TG). 

Published: 

— without international search report and to be republished 
upon receipt of that report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette, 



(54) Title: SELECTION OF MEDICAL IMAGES BASED ON IMAGE DATA 



< 
IT) 



Receive Scanned Image Data 



302 



Derive Cardiac Cycle Signal From 
Image Data 



304 



Filter Images To Include Those Where 
Heart Is At Desired Point In Cardiac 
Cycle 



306 



(57) Abstract: Systems and methods for deriv- 
ing a cardiac cycle signal by selecting images of 
a portion of a cardiovascular system include re- 
ceiving a plurality of images from a scanner that 
have been recorded over a period of time. The 
images represent one or more locations along the 
extent of the cardiovascular system. The images 
are then selected based on common criteria de- 
termined from the plurality of images and with- 
out reference to an external signal. The common 
criteria comprises changes in the size of a cross 
section of the aorta, changes in the volume of the 
heart, changes in the area of a cross section of 
the heart. In addition, the criteria can include the 
mean pixel difference between adjacent images. 
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SELECTION OF MEDICAL IMAGES BASED ON IMAGE DATA 



Field 

The present invention relates generally to medical imaging, and more 
5 particularly to systems and methods for performing temporal selection of 
medical images based on image data. 



Copyright Notiee/Permissinn 
A portion of the disclosure of this patent document contains material that 
10 is subject to copyright protection. The copyright owner has no objection to the 
facsimile reproduction by anyone of the patent dociun^ or the pat^t disclosure 
as it appears in the Patent and Trademark Office patent file or records, but 
otherwise reserves all copyright rigihts whatsoever. The following notice appUes 
to the software and data as described below and in the drawings hereto: 
15 Copyright © 2000, Vital Images, Inc. All Rights Reserved, 



Background 

Heart disease is a significant public health problem. Therefore, ia 
medicine, it is of considerable value to obtain cross-sectional and volumetric 

20 images of the human heart. Applications include angiography of coronary 

vessels for detecting stenosis, exanunation of the thoracic aorta for dissection of 
the vessel wall, and quantization of calcium deposits in the coronary arteries as a 
marker for atheroscerotic plaque. 

Recently, this last application has gathered significant interest due to the 

25 finding that the exam can be performed with a conventional high-speed helical 
CT (Computer Tomography) scanner, as opposed to the more expensive and less 
prevalent electron beam CT scanner. However, heUcal CT scanners are still too 
slow to "freeze" the motion of the heart, resulting in some cross-sectional images 
being blurred and out of register with other images captured at a different phase 

30 of the heart's cycle of contraction (systole) and relaxation (diastole). 

As a consequence, methods have been introduced to determine the heart 
cycle phase of axial CT images by simultaneously recording the • 
electrocardiogram (EKG), and synchronizing this signal witii the sequence of 
images. Since flie high saaaphtadG "r-wave" of the EKG is a reUable and very 
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brief indicator of the onset of ventricular contraction, it is straightforward to use 
its peak as an indicator of when heart motion will be near its most violent. It is 
then possible to either shut down image acquisition during these times, or 
retrospectively eliminate images that have been acquired at these times. This 
5 method is called EKG gating. 

The disadvantage of EKG gating is that it significantly lengthens the 
exam time due to the need to wire the patient Avith electrodes, etc. It also 
introduces additional complications in the design of the CT scanner and of the 
software xised to post-process the acquired images. It may additionally require 
10 manual verification of the selection of images, and introduces the possibility of 
mismatching EKG traces and images firom dififerent patients. 

As a result, there is a need in the art for systems and methods that can 
filter images acquired during an image scan of a patient without the need for 
external monitoring devices such as EKG monitors. 

15 

Summary 

The above-mentioned shortcomings, disadvantages and problems are 
addressed by the present invention, which will be understood by reading and 
studying the following specification. 

20 In one embodiment of the invention, a method for selecting images of a 

portion of a cardiovascular system uicludes receiving a plurality of images fiom 
a scanner that have been recorded over a period of time. The images represent 
one or more locations along the extent of the cardiovascular system. The images 
are then selected based on common criteria determined firom the plurality of 

25 images and without reference to an extemal signal. 

In some embodiments, the common criteria comprises changes in the size 
of a cross section of the aorta. In altemative embodiments, the common criteria 
comprises changes in the volume of the heart. In still further embodiments, the 
common criteria comprises changes in the area of a cross section of the heart. In 

30 yet other embodiments, the criteria includes the mean pixel difference between 
adjacent images. 

The present invention describes systems, clients, servers, methods, and 
computer-readable media of varying scope. In addition to the aspects and 
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advantages of the present invention described in this sximinary, further aspects 
and advantages of the invention will become apparent by reference to the 
drawings and by reading the detailed description that follows. 

5 Brief Description Of The Drawings 

FIG. 1 is a block diagram of the hardware and operating environment in which 

different embodiments of the invention can be practiced; 
FIG. 2 is a diagram illustrating a system level overview of an exemplary 
embodiment of the invention; 
10 FIG. 3 is a flowchart illustrating a method for performing retrospective gating of 
medical image data according to an exemplary embodiment of the 
invention; 

FIG. 4 is a flowchart providing further details on determining a signal used to 
filter images; and 

1 5 FIG. 5 provides a graph comparing the image based retrospective gating to prior 
art EKG gating. 

Detailed Description 

In the following detailed description of exemplary ^nbodiments of the 
20 invention, reference is made to the accompanying drawings which form a part 
hereof, and in which is shown by way of illustration specific exemplary 
embodiments in which the invention may be practiced. These embodiments are 
described in sufficient detail to enable those skilled in the art to practice the 
invention, and it is to be understood that other embodiments may be utilized and 
25 that logical, mechanical, electrical and other changes may be made without 
departing firom the scope of the present invention. The following detailed 
description is, therefore, not to be taken in a limiting sense. 

In the Figures, the same reference number is used throughout to refer to 
an identical component which appears in multiple Figures. Signals and 
30 connections may be referred to by the same reference number or label, and the 
actual meaning will be clear from its use in the context of the description. 

The detailed description is divided into multiple sections. In the first 
section tihe hardware and operating envirorment of different embodiments of the 

3 
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invention is described. In the second section, the software environment of 
varying embodiments of the invention is described. In the third section, methods 
of various embodiments of the invention are described. In the final section, a 
conclusion is provided. 

5 

Hardware and Operating Envi rnTtment 
FIG. 1 is a diagram of the hardware and operating environment in 
conjxmction with which embodiments of the invention may be practiced. The 
description of FIG. 1 is intended to provide a brief, general description of 

10 suitable computer hardware and a suitable computing environment in 

conjunction with which the invention may be implemented. Although not 
required, the invention is described in the general context of computer- 
executable instmctions, such as program modules, being executed by a 
computer, such as a personal computer, workstation, or a server computer. ^ 

15 Generally, program modules include routines, programs, objects, components, 
data structures, etc., that perform particular tasks or implement particular 
abstract data types. 

Moreover, those skilled in the art will appreciate that the invention may 
be practiced with other computer system configurations, including hand-held 

20 devices, multiprocessor systems, microprocessor-based or programmable 

consumer electronics, network PCs, minicomputers, mainframe computers, and 
the like. The invention may also be practiced in distributed computing 
environments where tasks are performed by remote processing devices that are 
linked through a commimications network. In a distributed computing 

25 environment, program modules may be located in both local and remote memory 
storage devices. 

As shown in FIG. 1, the computing system 100 includes a processor. 
The invention can be implemented on computers based upon microprocessors 
such as the PENTIUM® family of microprocessors manufactured by the Intel 
30 Corporation, the MIPS® family of microprocessors firom the Silicon Graphics 

Corporation, the POWERPC® family of microprocessors firom both the Motorola 
Corporation and the IBM Corporation, the PRECISION ARCHITECTURE® 
family of microprocessors firom the Hewlett-Packard Company, the SPARC® 
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family of microprocessors from the Sun Microsystems Corporation, or the 
ALPHA® family of microprocessors from the Compaq Computer Corporation. 
Computiag system 200 represents any personal computer, laptop, server, or even 
a battery-powered, pocket-sized, mobile computer known as a hand-held PC. 
5 The computing system 100 includes system memory 113 (including read- 

only memory (ROM) 114 and random access memory (RAM) 115), which is 
coimected to the processor 1 12 by a system data/address bus 116. ROM 114 
r^resents any device that is primarily read-only including electrically erasable 
progranmiable read-only memory (EEPROM), flash memory, etc. RAM 115 
10 represents any random access memory such as Synchronous Dynamic Random 
Access Memory. 

Within the computing system 1 00, input/output bus 1 1 8 is connected to 
the data/address bus 116 via bus controller 1 19. In one embodiment, input/output 
bus 1 18 is implemented as a standard Peripheral Component Interconnect (PCI) 

15 bus. The bus controller 1 19 ^amines all signals from the processor 1 12 to route 
the signals to the appropriate bus. Signals between the processor 112 and the 
system memory 1 13 are merely passed through the bus controller 1 19. However, 
signals from tbe processor 112 intended for devices other than system memory 
1 13 are routed onto the input/output bus 118. 

20 Various devices are coimected to the input/ou^ut bus 118 including hard 

disk drive 120, floppy drive 121 that is used to read floppy disk 151, and optical 
drive 122, such as a tD-ROM drive that is used to read an optical disk 152. The 
video display 124 or other kind of display device is connected to the input/output 
bus 118 via a video adapter 125. 

25 A user enters commands and information into the computing system 100 

by using a keyboard 40 and/or pointing device, such as a mouse 42, which are 
connected to bus 118 via input/output ports 128. Other types of pointing devices 
(not shown in FIG. 1) include track pads, track balls, joy sticks, data gloves, 
head trackers, and other devices suitable for positioning a cursor on the video 

30 display 124. 

As shown in FIG. 1, the computing system 100 also includes a modem 
129. Although illustrated in FIG. 1 as external to the computing system 100, 
those of ordinary skill in the art will quickly recognize that the modem 129 may 
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also be internal to the computing system 100. The modem 129 is typically used 
to commimicate over wide area networks (not shown), such as the global 
Internet. The computing system may also contain a network interface card 53, as 
is known in the art, for communication over a network. 
5 Software applications 136 and data are typically stored via one of the 

memory storage devices, which may include the hard disk 120, floppy disk 151, 
CD-ROM 152 and are copied to RAM 1 15 for execution. In one embodiment, 
however, software applications 136 are stored in ROM 1 14 and are copied to 
RAM 1 15 for execution or are executed directly from ROM 1 14. 

10 In general, the operating system 135 executes software applications 136 

and carries out instructions issued by the user. For example, when the user wants 
to load a software application 136, the operating system 135 interprets the 
instruction and causes the processor 1 12 to load software application 136 into 
RAM 115 from either the hard disk 120 or the optical disk 152. Once software 

15 application 136 is loaded into the RAM 1 15, it can be used by the processor 1 12. 
In case of large software ^plications 136, processor 112 loads various portions 
of program modules into RAM 1 15 as needed. 

The Basic Input/Output System (BIOS) 117 for the computing system 
100 is stored in ROM 1 14 and is loaded into RAM 115 upon booting. Those 

20 skilled in the art will recognize that the BIOS 1 17 is a set of basic executable 
routines that have conventionally helped to transfer information between the 
computing resources within the computing system 100. These low-level service 
routines are used by operating system 135 or other software applications 136. 
In one embodiment computing system 100 includes a registry (not 

25 shown) which is a system database that holds configuration information for 

computing system 100. For example, Windows® 95 , Wiadows 98®, Wiadows® 
NT, and Windows 2000® by Microsoft maintain the registry in two hidden files, 
called USER.DAT and SYSTEM.DAT, located on a permanent storage device 
such as an internal disk. 



Software Environment 
The embodiments of the invention describe a software environment of 
systems and methods that provide for the retrospective gating of medical images. 
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FIG. 2 is a block diagram describing the major components of such a system. 
As shown, the system includes an image scanner 202 and an image processing 
system 206. 

Image scanner 202 in one embodiment of the invention is a CT scanaer. 
5 The scanner can be a high-speed helical CT scanner, or it can be an electron 
beam CT scaimer. However, the invention is not limited to CT scanners, an any 
scanner that can provide a sequence of images recorded over a period of time are 
within the scope of the invention. For example, scanner 202 could be a 
Magnetic Resonance Imaging (MRI) or ultrasound scanner. 
10 Scanner 202 produces image data 204 that comprises a sequence of two- 

dimensional images of the human body. This image data is then sent to image 
processing system 206 for processing. In one embodiment of the invention, 
image processing system 206 is the LnageGate system from Vital Images, Inc. 
The image data can be transferred &om scanner 202 to image processing system 
15 206 using any data transmission means, including tape media, CD-ROM, floppy- 
disk, removable hard drive, and network means, including ttie LitemeL 

Image processing system 206 is a suitably configured computer, such as 
the computer illustrated in FIG, 1, and employs tiie methods detailed below to 
perform retrospective gating of the image data. The output of system 206 
20 comprises cardiac cycle signal 208 and filtered image data 210. Filtered image 
data 210 comprises the image data that corresponds to images acquired at 
desired points in the cardiac cycle signal 208. 

This section has described the various system components in a system 
that performs image based retrospective gating of cardiac images. As those of 
25 skill in the art will appreciate, the software can be written in any of a number of 
programming languages known in the art, including but not limited to C/C+H-, 
Visual Basic, Smalltalk, Pascal, Ada and similar programming languages. The 
invention is not limited to any particular programming language for 
implementation. 

30 



Methods of an Exemplary E mhndimf ^t of the Invention 
In the previous section, a system level overview of the operation of an 
exemplary embodiment of the invention was described. In this section, the 
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particular methods of various embodiments of the invention perfomied by an 
operating environment executing an exemplary embodiment are described by 
reference to a flowchart shown in FIGs. 3 and 4, The methods to be performed 
by the operating environment constitute computer programs made up of 
5 computer-executable instructions. Describing the methods by reference to a 
flowchart enables one skilled in the art to develop such programs including such 
instractions to carry out the methods on suitable computers (tiie processor of the 
computer executing the instructions from computer-readable media). The 
methods illustrated in FIGs. 3 and 4 are inclusive of the acts required to be taken 
10 by an operating environment executing an exemplary embodiment of the 
invention. 

The methods of the various embodiments of the invention illustrated 
below operate to perform time categorization and selection of a subset of images 
from a plurality of images based on the image data alone, that is, without 

IS reference to any extemal signals such as an EKG. In some embodiments of the 
invention, the plurality of images comprise a series of images that are received 
from a CT scanning system in which multiple images are taken at different 
points in time of a single space of a body. In other embodiments, the plurality of 
images can comprise a sequence of images in which one image of a space of a 

20 body at a single point in time is taken. 

A method for categorizing and selecting images according to an 
embodiment of the invention for performing image-based retrospective gating of 
seamed medical image data is illustrated in FIG. 3. A system executing the 
method begins by receiviag scaimed image data (block 302). In one 

25 embodiment of the invention, the scanned image data is received from a CT 
scaimer such as scanner 202 (FIG. 1). However, the invention is not limited to 
any particular method of obtaining the scanned image data. As will be 
appreciated by those of skill in the art, any system capable of producing a 
volxmietric sequence of images is withia the scope of the invention. It is 

30 desirable that the images are heavily overlapped axial images of the chest. The 
axial overlap provides the ability for the system to select a subset of images 
acquired when the heart was most at rest and still adequately sample the heart to 
its ftdl anatomical extent. 



8 
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In one embodiment of the invention, the categorization and selection of 
images operates to select those images that are the least blurred. In the case of 
cardiac image data, the least blurred images represent those points in time in the 
cardiac cycle when the heart is at rest in between beats. In some embodiments 
5 of the invention, a Fourier transform is used to determine **bluiTiness" of an 
image. 

In alternative OTibodiments, the Mean Pixel Difference (MPH) between 
one image and a subsequent adjacent image is determined. The images with the 
lowest MPD are selected as being the least blurry images. In MPD, each pixel 

10 on a first axial image is subtracted fcom the corresponding pixel on the 

subsequent adjacent axial inoiage. The absolute value of the pixel dififerences for 
the image are summed and divided by the number of pixels in flie image. This 
single number for each image is the MPD. An image with a lower MPD than 
another image can be said to be less blurry. 

15 Next, those images that are the least bliury, or whose blurriness are 

within a particular tolerance, are then selected for inclusion in the set of images 
for which further analysis, such as volumetric analysis, will be performed. 

The image processing system derives a cardiac cycle signal Scorn the 
image data (block 304). The various phases of the cardiac cycle can be derived 

20 from the image data by detecting in the image data the corresponding motion or 
changes of different parts of the heart and/or other parts of the body affected by 
the motion of the heart, such as blood vessels. By measuring this motion as a 
function of a time, a periodic signal can be derived that can be used to determine 
heart rate and cardiac cycle phase for any time during the image data collection. 

25 Finally, the image data is filtered according to the cardiac cycle signal 

determined at block 304 to select those images that where acquired when the 
heart was most at rest (block 306). The filtered images can then be used to 
render accurate volimietric images of the heart. ' 

Various methods can be used to determine the cardiac cycle in block 304 

30 above. The methods generally determine the cycle based on criteria common to 
the images. One such method according to an embodiment of the invention 
detects changes in the cross-section of the aorta, and is illustrated in FIG. 4. The 
method begins by estimating the position of the aorta (block 402). Various 
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means can be used to detect the position of the aorta. For example, in some 
embodiments of the invention, a matching filter as is known in the art is used to 
detect the aorta. In alternative embodiments, an Active Appearance Model is 
used to detect the position. In further altemative embodiments, an Active Shape 
S Model is used. 

In still further embodiments of the invention, an algorithm called Hough 
Transform is used to find the approximate aorta position. As is known in the art, 
the Hough Transform can be regarded as a generalized template matching 
method, and is typically used to extract out edges or curves fiom an image. The 

10 Hough Transform can be used to extract circles and even generalized (perhaps 
non- symmetrical) edges. Use of the Hough Transform is desirable, because it is 
invariant to rotation and translation. Further details on the Hough Transform can 
be found in U.S. Patent 3,069,654, which is hereby incorporated by reference 
herein. For the purpose of Hough Transform, aorta can be described as a circle 

IS of radius in a range 8 - 2Smm. 

In one embodiment of the invention, the position of the aorta is 
determined only in the first image. For the following images, the results of 
segmentation in the previous image are used. This is desirable because it 
reduces the time required to execute tiie method. The approximate aorta border 

20 in the (z + 1) image is defined as a circle of radius Rres^ where Rres is the radius 
of the circle found by Hough transform in image z. The circle is centered at 
position (Xc(z), Yc(z)), which is the center of aorta found in the previous, z 
image. Because processing each image is a sequential process, it is vulnerable to 
error propagation. In one embodiment of the invention, the likelihood of 

25 possible error propagation is reduced by using the same circle radius to initialize 
the aorta segmentation and only updating its position in subsequent images. 

In another embodiment of the invention, a voting mechanism for 
detecting the aorta is used. The Hough Transform is applied to a sequence of 
five consecutive images. A result is accepted, if the aorta center is found in a 

30 similar location in at least four of these images. If such a match is not found, 
another set of five images is investigated. 

In the Hough transform, a fit value is determined for every pixel in an 
image. The fit value represents the probability that the point belongs to the aorta 

10 
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border. The computation of fit values is based on a priori knowledge of the aorta 
properties in CT images. 

For every pixel (x, y) in an image, the fit value is computed as 



where: 

I(x, y) is the image intensity in Hounsfield Units [HU]. 
g is the image gradient. 

^fsxpeaed is the expected direction of the gradient 
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In one embodiment of the invention, a directional gradient detector based 
on 5 X 5 Gaussian mask is used. In the case of the Hough Transform, the 
expected direction is not known. Therefore, one embodiment of the invention 
uses the following formula to set n^^^ 

15 H,^^.=ilr (2) 



1^1 

Function f(.) in formula (1) is a transformation function Hist limits the 
maximum value of the considered gradient. The transformation function f(.) in 
one embodiment of the invention is: 



{a:a< 
(a) = ^ ^ 



/(«) = i_ .r (3) 

20 where is the gradient response to a step edge of volume lOOHU. 

After estimating the position of the aorta, the method then segments (i.e. 
detects) the aorta in each of the 2D images in the sequmce (block 404). In some 
embodiments of the invention, edge-based dynamic programming as is known in 
the art is appUed to the images in order to segment the aorta. In alternative 

25 embodiments. Active Contours, also referred to as "Snakes" are used to detect 
the aorta. la further embodiments of the invention, region growing algorithms 
are used to detect the aorta. Such algorithms are known in the art. 

In one particular embodimoat of the invention, the aorta is segmented 
using a dynamic programming based boimdary detection algorithm. Details of 

11 
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such a boundary detection algorithm are presented m M. Sonka, V. Hlavac, R. 
Boyle, Image Processing, Analysis, and Machine Vision; PWS PubUshing, 2"^ 
edition, 1998, pp. 158-163, which is hereby incorporated by reference herein. 
The approximate aorta location determined at block 402 is used to create a 
5 Region ofInterest(ROI) within which the aorta boundary is sou^t. For the 
purpose of searching the image for the aorta, the ROI is mapped into a 
rectangular graph, in which every node (xq, yo) corresponds to one image pixel. 
This is expressed in the following formula: 

(Xg > J^c ) = centerlinePointix^ ) + «c (^g ) • iVo " ^^^y^) (4) 
10 where: 

is the unit normal vector to the circular centerline at xoth point 

along the centerline; and 

width is the width of the ROI. 

1 5 Every node in the rectangular graph has a cost associated with it. The 

cost is given by the formula: 

cost(x, y) = niax(^^(i, j) - fit{x, y)) (5) 

where: 

fit is defined by Equation 1 with Uexpected = Oc. 

20 

The method jSnds a path of minimal cost between any node in the iSrst 
column and any node in the last column of the rectangular graph. To ensure that 
the found boundary is a closed contour, the search is restricted by forcing the 
first and last points of the minimal cost path have to have the same Yq 
25 coordinate in the rectangular graph. 

In addition to assigning a cost to every graph node, a cost is assigned to 
every link between graph nodes. Only nodes in 2 consecutive colunms are 
connected by links. The costs are assigned according to the following formula: 



30 



costKjc/, yj\ (jci + 1, ;;*)] = 



0 ifk^j 
0.3 • cost(xi, yj) if j±l 
00 otherwise 



(6) 
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Such a cost assignment eflfectively connects only nodes whose y 
coordinate differs by no more than one. It ensures connectivity of the resulting 
boundary. The middle rule in Equation 6 for assigning cost reflects the 
5 knowledge that the sought border should be circular. Thus, a border that is 

parallel to the ROI centerline (a circle) is considered to be a preferred direction 
over a direction that diverges from the ROI centerUne direction. The minimum 
cost path is then mapped into the original image and represents the aorta border. 
After determining the position of the aorta, the method then computes the 

1 0 area of the aorta cross-section in the image (block 406). The cross-sectional area 
in the image is then used to compute an approximation of the volume of aorta at 
the time of an image acquisition. The area is computed as an area enclosed by 
the aorta border foimd by the aorta segmentation in block 404. In one 
embodiment of the invention, for every image, the found border is projected onto 

15 a plane that is perpendicular to the aorta direction. This provides better 

q>proximation of the true cross-sectional area of the aorta in cases when the 
image acquisition plane is not perpendicular to the aorta direction. 

The aorta direction for a given image can be approximated by a tangent 
to a line connecting centers of gravity of outlined aorta boundaries. In some 

20 embodiments of the invention, the line is smoothed using algorithms known in 
the art. 

Every border point (x, y, z) is projected into a point (xp, yp, zp) as 
follows: 







X 










y 


+ 




Zp 




z 







(t^c) (7) 



25 where: 

t is the unit vector representing aorta direction; and 

? is a vector connecting the boundary point (x, y, z) 
with the aorta center in the given image. 
The aorta center can be computed from its boundary points, yielding 
30 the following con:q>utation of the vector c : 
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z 





(8) 



where: 

(x/ ,yi ,Zi) are the aorta boundary points 
5 is the total number of boundary points. 



In some embodiments of the invention, the area computation is 
simplified by expressing the projected border in a new coordinate system (Wx, 
Wy, Wz) in which the Wz coordinate of all the boundary pouits is zero. The new 
> 10 coordinate system is determined as follows: 



15 



TV., 



(9) 



Thus, the coordinate transformation can be computed as: 



'x'' 




'x/ 


y' 


= T 


yp 


z'_ 







(10) 



where: 



•3^ 



(11) 



Becavise z' = 0 for all points of the transformed border, in some 
embodiments the area of the aorta cross-section is computed using a discrete 
20 implementation of Simpson's Rule. Such algorithms are known in the art. 
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The sequence of values representing the aorta cross-sectional areas 
represent an in-time regularly sampled signal that can be used to compute the 
heart rate and the phase of the cardiac sample for every image in the sequence. 

In some embodiments of the invention, the signal determined is filtered 
5 to remove noise and to simplify cardiac phase detennination (block 408). In 
some embodiments of the invention, filtering is performed by a Buttoworth 
filter* It is desirable that the filter is designed so that lliere is no more than 3dB 
atteniiation in the pass band and at least 40dB attenuation in the stop band* In 
order to determine the band pass of the filter, the aorta area signal is first High 
10 Pass Filtered (HPF) in order to remove DC component and low firequencies that 
may correspond to the change of aorta size in space rather than in time. In some 
embodiments, the HPF signal (Shpf) is computed using a digital high-pass filter 
based on the Butterworth filter. 

Next, the heart rate is determined. In some embodiments, it is estimated 
15 by determining the main firequency component in the area signal. It is desirable 
to avoid rasterization and to ensure stability, thus some embodiments determine 
the main firequency not &om the original signal, but firom the signal's 
autocorrelation: 

/max = arg max\\Founer{sHPF * sHPF}\\ (12) 

20 where ^ denotes the correlation operation. 

The raw aorta area signal is then filtered with a Butterworth filter with a 
passing band of < 0.7 /,1.3/ > , which represents an estimated variation of the 
heart rate for a single patient during the scanning procedure. In order to improve 
the filtering results, some embodiments use the signal obtained using the above- 

25 described filtering to compute new values of fL and fe. The beginning of each 
period is determined by positively sloped zero crossings of the signal. The 
newly obtained limits are used to finally filter the signal according to the 
following formula: 

ix) = Butterworth{s{x),f^M , 

30 where: 

s denotes the raw aorta area signal; and 

< , > is the frequency range of the pass band. (13) 
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In alternative embodiments, signal filtering is perfomied by applying an 
alternative HPF to the aorta signal, again, in order to remove DC component and 
low jfrequencies that may correspond to change of aorta size in space rather than 
in time. In these embodiments, the HPF can be approximated by subtracting a 
5 moving average from the original signal according to the following: 

S'""'ix) = s(x)-j^s(x + i) (14) 
where s denotes the raw aorta area signal. 

Next, in order to remove noise from the signal and thus simplify the 
determination of points of maximum positive gradient that corresponds to the 

10 opening of aortic valve, the signal is smoothed. 

In alternative embodiments of tiie invention, smoothing is performed 
using Band Pass Filtering (BPF) in a frequency domain. A moving window 
Fourier Transform can be used to smooth the signal separately in short segments. 
The window width is chosen so that it corresponds to approximately three 

15 cardiac cycles and is a power of 2 (to simplify the employment of Fast Fourier 
Transform algorithm). The width of the BPF is chosen to be one, thus 
considering only the basic frequency fliat occurs in the given segment of the 
signal. The BPF frequency is selected as the highest frequocicy in the spectrum 
(not considering zero frequency - the signal offset). The window for the Fourier 

20 Transform is always moved by just one sample and the smoothed signals are 
averaged in the time domain. The filtering is illustrated in the following 
formula: 

BPF^is^,^^) = Fourier-' {Fourier {s,,,^^^ • Filter^ ^}} (15) 
where: 

25 Filter is a BPF with a passing frequency: 

^ = arg naax Fourier {s^,^^} (16) 

fe<l,w/2> * 

and the vraidow width iv is a power of 2. 

The fioaal filter signal is thus: 

30 S'>"'(t)= £ BPF{S,jj,^Ki-J) . ' T. rr (17) 

y=nua{/-«,.o) minO, N-w)~ max(i - w,0) 
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where N is the number of samples in the aorta area signal. 

After the signal has been filtered, the method determines the cardiac 
5 phase (block 410). Depending on the heart rate of the person being scanned and 
on the image acqxiisition speed, 6-12 images can typically be obtained per 
cardiac cycle. It is generally the case that the opening of the aortic valve is 
followed by tihie maximum rate of change (max. gradient) of aortic pressure that 
is reflected by the maximum gradient of increase of aorta cross-sectional area. 

10 This happens approximately 0.1 seconds after the beginning of ventricular 
polarizatiorL To match the aorta area signal to the heart cycle the method 
searches for the points of maximum positive gradient, which generally 
correspond to the moments of aortic valve opening. 

The filtered signal approximates the time change of aorta cross-sectional 

1 5 area (volume) during a cardiac cycle. Thus, one period of the signal corresponds 
to one cardiac cycle. Since signal can be approximated by a sine wave, the 
maximum positive derivative of the signal can be determined and used as the 
point of a positively sloped zero crossing. Using linear interpolation, the method 
can determine that the zero crossing point Xz between signal points (x, yi) and (jc 

20 + 1, >'2), such that is: 

X, = +x (18) 

Thus the set of times (x^) represents the instants corresponding to aortic 
25 valve openings. From the aortic valve openings, the point in the cardiac cycle 
signal can be determined where the heart is most at rest. 

In order to remove possible errors in the signal filtering, some 
embodiments of the invention perform post-processing on the signal. Based on 
the derived heart rate statistics (mean and standard deviation), outliers 
30 representing too short heart rate can be rCTioved and/or a heart cycle can be 
added if the measured one is too long. 



17 



wo 02/26125 



PCTAJSOl/30011 



The above-described signal filtering techniques can be used for both 
helical scanning systems and for multi-sUce scanning systems. In the case of 
multi-sUce scanning systems, the scanning protocol is generally a ^'step and 
shoot' ' procedure, which results in a signal consisting of short measured pieces 
5 (1-2 heart cycles) interlaced with segments of 1-2 heart cycles without any data. 
In such systems there are typically more than one measurement of every 
segment. Usually fliere are four segments, and the segments are synchronized. 
In order to use the same filtering scheme as above, the existing signals are 
averaged to obtain one signal, resulting in a higher S/N ratio. Then, the missing 

10 segments ofthe signal are reconstracted. Amethodfor restoration of lost 
samples in digital signals is described in detail in Raymond Veldhuis: 
Restoration of Lost Samples in Digital Signals. Prentice Hall Intemational Series 
in Acoustics, Speech and Signal Processing, 1990 Prentice Hall Intemational 
(UK) Ltd., ISBN - 0-13-775198-2, Chapter 3 Autoregressive processes, pp, 28- 

15 56. In some embodiments, this algorithm is used to fill the missing data. 

However, the invention is not limited to the algorithm described in Veldhuis, and 
any algorithm capable of restoring lost samples can be used. When the signal is 
reconstmcted to its fiill length, the same filtering scheme as described above can 
be employed 

20 The method of deteriniiiing the cardiac cycle illustrated in FIG. 4 is 

desirable, for several reasons. First, it is easy to measure accurately because a 
reliable segmentation algorithm exists. Second, measuring the cross section of 
the aorta is insensitive to the shifting and twisting that occurs as the heart beats. 
Finally, measuring the cross section ofthe aorta is independent of heart 

25 geometry changes in the space domain (changes firom one acquired image to 

another). However, the invention is not limited to deriving a cardiac cycle signal 
based on the changes in the area of the cross section of the aorta. For example, 
changes in the area of cross section of other blood vessels besides the aorta can 
be detected and used to derive a signal. In addition, the invention is not limited 

30 to detecting changes in the area of a blood vessel such as the aorta. In alternative 
embodiments ofthe invention, the motion of a blood vessel wall is determined 
and used to derive a signal. 

FIG. 5 illustrates a sample of the signals obtained using the methods 
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described above. Graph 502 illustrates the difference between an EKG-derived 
signal an image-derived signal for ventricular systole. Graph 504 illustrates the 
difference between an EKG-derived heart rate and an image-derived heart rate. 
Graph 506 presents two signals, Raw signal 508 which represents the signal 
5 before filtering, and filtered signal 510 which represents the signal after the 
filtering described above has been apphed. 

In an alternative embodiment of the invention, the cardiac signal can be 
derived using a "Mean Pixel Difference" (MPD) between the acquired images. 
As noted above, in MPD, each pixel on a first axial image is subtracted &om the 

10 corresponding pixel on the subsequent adjacmt axial image. The absolute value 
of the pixel differences for the image axe smnmed and divided by the number of 
pixels in the image. This single number for each image is the MPD. 

The MPD thus repres^ts a direct measure of changes in the data 
between two image slices. The sequence of MPD values can thus be used to 

15 derive a cardiac cycle signal. Using the MPD is not as desirable as using the 
changes in the area of cross-sections of the aorta, because other factors besides 
heart motion can affect the calculation of the MPD. For example, the difference 
is often caused not only by the heart motion, but also by the change of the heart 
geometry as the scan progresses both in the time and spatial domains. 

20 In a ftirther alternative embodiment of the invention, the cardiac signal 

can be derived using the fact that the heart volume periodically decreases and 
increases during systole and diastole. By measuring these changes in heart 
volume (or area of heart cross-section) across a sequence of images, a cardiac 
cycle can be computed. The reUable measurement of the heart cross-sectional 

25 area requires accurate segmentation of the heart in each of the images. The 
cross-sectional area can then be used to determine a cardiac cycle signal in a 
manner similar to that described above in reference to FIG. 4. 

In a still further embodiment of the invention, heart border motion can be 
xised to derive a cardiac cycle signal. Here, heart border motion is measured by 

30 detecting the motion in the walls of the heart. For example, the atrium and 
ventricle borders. This can provide the same information as measurement of 
heart cross-sectional area. In this embodiment, easy-to-segment parts of the 
heart are measured and the changes in the measurements used to derive a cardiac 
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cycle signal. 

Conclusion 

Systems and methods for using image data to derive signals, such as 
5 cardiac cycle signals have been disclosed. The embodiments of the invention 
provide advantages over previous systems. For example, there is no need to 
attach wires to the patient for EKG, which can reduce patient apprehension and 
nervousness about the imaging procedure. Furthermore, deriving the cardiac 
cycle from the image data eliminates the possibility that the EKG cycle data does 

10 not match the image data due to mishandling of the EKG data, since no EKG 
data is required. Moreover, EKG data can provide a less than accurate cardiac 
cycle due to variations in the measurement of electrical signals generated by the 
heart. The image data captures the heart motion directly, unlike the EKG. 
Although specific embodiments have been illustrated and described 

15 herein, it will be appreciated by those of ordinary skill in the art that any 

arrangement which is calculated to achieve the same purpose may be substituted 
for the specific embodiments shown. This application is intended to cover any 
adaptations or variations of the present invention. 

The terminology used in this application is meant to include aU of these 

20 environments. It is to be understood that the above description is intended to be 
illustrative, and not restrictive. Many other embodiments will be apparent to 
those of skill in the art upon reviewing the above description. Therefore, it is 
manifestly intended that this invention be limited only by the following claims 
and equivalents thereof. 

25 
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We claim: 

1 . A method for selecting images of a portion of a cardiovascular system 
comprising: 

receiving from an image scanner a plurality of images recorded over a 
5 period of time, the images representiug one or more locations along the extent of 
the cardiovascular system; and 

selecting at least a subset of the images based on common criteria 
determined from the pluraUty of images and without reference to an external 
signal. 

10 

2. The method of claim 1, wherein the portion of the cardiovascular system 
is the heart. 

3. The method of claim 1, wherein the image scanner is a CT (Computer 
15 Tomography) scanner. 

4. The method of claim 1, wherein the image seamier is a MRI (Magnetic 
Resonance Image) scanner. 

20 5. The method of claim 1 , wherein the image scann^ is an Ultrasound 
scann^. 

6. The method of claim 1, whereiu selecting a subset of the images results 
from a determination of the bluiriness of each image. 

25 

7. The method of claim 6, wherein the blurriness of the image is determiued 
by a Foinier transform appUed to the image. 

8. The method of claim 6, wherein the blurriness of the image is determined 
30 by the mean pixel difference between the image and an adjacent image. 
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9. The method of claim 1, wherein selecting a subset of the images results 
from a determination of a change of a relative position of at least one vessel edge 
in each image. 

5 10. A method for ordering a pluraUty of images of a portion of a 
cardiovascular system comprising: 

receiving from an image scaimer a plurality of images recorded over a 
period of time, the images representing one or more locations along the extent of 
the cardiovascular system; 
10 deriving a cardiac cycle signal from the plurality of scanned images; and 

assigning a phase in the cardiac cycle to each scanned image. 

1 1 . The method of claim 1 0, wherein the portion of the cardiovascular 
system is the heart. 

15 

12. The method of claim 10, wherein the image scanner is a CT (Computer 
Tomography) scanner. 

1 3 . The method of claim 1 0, wherein the image scanner is a MRI (Magnetic 
20 Resonance Image) scanner. 

14. The method of claim 10, wherein the image scaimer is an Ultrasoxmd 
scaimer. 

25 15. The method of claim 10, wherein deriving the cardiac signal comprises: 
segmenting a set of data representing a blood vessel in each image; 
computing a change value for the blood vessel; and 
determining the cardiac cycle signal based on a sequence of the change 
values for each image. 

30 

16. The method of claim 15, wherein the change value is a change in the area 
of a cross section of the blood vessel. 
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17. The method of claim 15, wherein the change value is a change in the 
position of a wall of the blood vessel. 

18. The method of claim 10, wherein deriving the cardiac cycle signal 
5 comprises: 

segmenting a set of data representing a cross-section of fhe aorta in each 
image; 

computing an area value representing an area of the cross-section; and 
determining the cardiac cycle signal based on a sequence of the area 
1 0 values for each image. 

19- The metihod of claim 18, further comprising estimating the position of tiie 
aorta within the image data prior to segmenting fhe set of data. 

15 20. The method of claim 1 9, wherein estimating the position of the aorta 
utilizes a Hough transform. 

21 . The method of claim 1 8, wherein segmenting of the aorta cross-section 
utilizes Dynamic Programming. 

20 

22. The method of claim 1 8, further comprising filtering the cardiac cycle 
signal to produce a smoothed cardiac cycle signal. 

23. The method of claim 10, wherein deriving the cardiac cycle signal 
25 comprises: 

for each image in the plurality of images performing the tasks of: 

selecting an adjacent subsequent image; 

calculating a mean pixel difference between the image and the 
subsequent image; and 
30 detemMiring the cardiac cycle signal based on the mean pixel 

difTerences of the images. 
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24. The method of claim 10, wherein deriving the cardiac cycle signal 
comprises: 

segmenting a set of data representing a cross-section of a heart in each 
image; 

5 computing an area value representing an area of the cross-section; and 

determining the cardiac cycle signal based on a sequence of the area 
values for each image. 

25. The method of claim 10, wherein deriving the cardiac cycle signal 
10 comprises; 

for each image in the plurality of images performing the tasks of: 
determining a first border of a heart in the image; 

determining a second border of the heart in a subsequent adjacent image; 
determining the difference between the first border and the second 
15 border; and 

determining the cardiac cycle based on a sequence of the differences. 

26. The method of claim 10, wherein the ordered set of images is further 
filtered to produce a subset of images, said subset of images comprising images 

20 acquired at a desired point in the cardiac cycle signal. 

27. The method of claim 10, wherein the derived cardiac cycle signal is used 
to interpolate or reconstruct new images at specific phases in the cardiac cycle 
firom the original scanned images or other related data. 

25 

28. A computer-readable medium having computer executable instructions 
for performing a method for selecting images of a portion of a cardiovascular 
system, the method comprising: 

receiving from an image scanner a plurality of images recorded over a 
30 period of time, the images representing one or more locations along the extent of 
the cardiovascular system; and 
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•selecting at least a subset of the images based on common criteria 
determined from the plurality of images and without reference to an external 
signal. 

5 29. The computer-readable medium of claim 28, wherein the portion of the 
cardiovascular system is the heart. 

30. The computer-readable medium of claim 28, wherein the image scanner 
is a CT (Computer Tomography) scanner. 

10 

3 1 . The computer-readable medium of claim 28, wherein the image scaxmer 
is a MRI (Magnetic Resonance Image) scaimer. 

32. The computer-readable medium of claim 28, wherein the image scanner 
15 is an Ultrasound scanner. 

33. The computer-readable medium of claim 28, wherein selecting a subset 
of the images results from a determination of the blurriness of each image. 

20 34. The computer-readable medium of claim 33, wherein the blinriness of 
the image is detranined by a Fourier transform appUed to the image. 

35. The computer-readable medium of claim 33, wherein the blurriness of 
the image is determined by the mean pixel difference between the image and an 

25 adj acent image. 

36. The computCT-readable medixmi of claim 28, wherein selecting a subset 
of the images results from a determination of a change of a relative position of at 
least one vessel edge in each image. 



30 



37. A computer-readable medium having computer executable rnstmctions 
for performing a method for ordering a plurality of images of a portion of a 
cardiovascular system, the method comprising: 
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receiving from an image seamier a plurality of images recorded over a 
period of time, the images representing one or more locations along the extent of 
the cardiovascular system; 

deriving a cardiac cycle signal from the plurality of scanned images; and 
5 assigning a phase in the cardiac cycle to each scanned image. 

38. The computer-readable medium of claim 37, wherein the portion of the 
cardiovascular system is the heart. 

1 0 39. The computer-readable medium of claim 37, wherein the image scanner 
is a CT (Computer Tomography) scanner. 

40. The computer-readable mediimi of claim 37, wherein the image scaimer 
is a MRI (Magnetic Resonance Image) scanner. 

15 

41 . The computer-readable meditmi of claim 37, wherein the iinage scanner 
is an Ultrasound scanner. 

42. The computer-readable medium of claim 37, wherein deriving the 
20 cardiac signal comprises: 

segmenting a set of data representing a blood vessel in each image; 
computing a change value for the blood vessel; and 
determining the cardiac cycle signal based on a sequence of the change 
values for each image. 

25 

43. The computer-readable medium of claim 42, whereiu the change value is 
a change in the area of a cross section of the blood vessel. 

44. The computer-readable medium of claim 42, wherein the change value is 
30 a change in the position of a wall of the blood vessel. 

45. The computer-readable medium of claim 37, wherein deriving the 
cardiac cycle signal comprises: 
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segmenting a set of data representing a cross-section of the aorta in each 
image; 

computing an area value representing an area of the cross-section; and 
determining the cardiac cycle signal based on a sequence of the area 
5 values for each image. 

46. The computer-readable medium of claim 45, further comprising 
estimating the position of the aorta within the image data prior to segmenting the 
set of data. 

10 

47. The computer-readable medium of claim 46, wherein estimating the 
position of the aorta utilizes a Hough transform. 

48. The computer-readable medium of claim 45, wherein segmenting of the 
1 5 aorta cross-section utilizes Dynamic Programming. 

49. The computer-readable medium of claim 45, further comprising filtering 
the cardiac cycle signal to produce a smoothed cardiac cycle signal. 

20 50. The computer-readable medium of claim 37, wherein deriving the 
cardiac cycle signal comprises: 

for each image in the plurality of images performing the tasks of: 
selecting an adjacent subsequent image; 
calculating a mean pixel difference between the image and the 
25 subsequent image; and 

determining the cardiac cycle signal based on the mean pixel 
differences of the images. 

5 1 . The computer-readable medium of claim 37, wherein deriving the 
30 cardiac cycle signal comprises: 

segmenting a set of data representing a cross-section of a heart in each 
image; 

computing an area value representing an area of the cross-section; and 
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determining the cardiac cycle signal based on a sequence of the area 
values for each image. 

52. The computer-readable medium of claim 37, wherein deriving the 
5 cardiac cycle signal comprises: 

for each image in the plurality of images performing the tasks of: 
determining a first border of a heart in the image; 

determining a second border of the heart in a subsequent adjacent image; 
determining the difference between the first border and the second 
10 border; and 

determining the cardiac cycle based on a sequence of the differences. 

53. The computer-readable medium of claim 37, wherein the ordered set of 
images is further filtered to produce a subset of images, said subset of images 

15 comprising images acquired at a desired point in the cardiac cycle signal. 

54. The computer-readable medium of claim 37, wherein the derived cardiac 
cycle signal is used to interpolate or reconstruct new images at specific phases in 
the cardiac cycle firom the original scanned images or other related data. 

20 

55. A computerized image processing sj^tem comprising: 

a data storage subsystem operable to store a plurality of medical images; 
an image processing subsystem operable to select at least a subset of the 
plurality of medical images based on common criteria determined from flie 
25 plurality of medical images and without reference to an external signal. 

56. The system of claim 55, wherein the image processing subsystem derives 
a cardiac cycle signal and wherein the selection of medical images is based on 
the cardiac cycle signal. 

30 
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A) DIFFERENCE BETWEEN EKG-DERFs/ED AND IIVIAGE-DERIVED VENTRICULAR SYSTOLE 
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B) COMPARISON OF EKG-DERIVED AND IMAGE-DERIVED HEART RATE 
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